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ABSTRACT** 

^ . ' While thfe rationalistic approach traditionally 

employed in* research and development efforts in the social, sciences 
•may be the best mfethod of inquiry to ^use in the .physical sciences, 
social scientists, and, more particularly, vocational education 
researchers, would do better to' adopt a naturalistic method_of 
research. The naturalist approach, to inquiry is better -Suited fpr * 
educational research , beCMye it rmpgtiizes the multiple nature of 
realityipthe necessary *^»?:actijpn between researcher and respondent, 
and the impossibility otjnakirtg generalizations among similar 
situationalVcontext? . Despite the fact that practitioner^ of the* 
naturalistic; approach' do /not emphasize rigor over relevanpe as do 
practitioners of the rationalistic mode*- of -research, their* tesear9h 
i$ not necessarily sloppy. On \the contrary, naturalists have their 
« own way c^K dealing with the issues ot credibility, transferability,, 
; dependability, and conf irmability of data/ Adoption of the' / 
N aturalistic a pproach would have enormous implications for research 
*Md development in the area of Vocational education. Among these 
~ implications are the following t the notion, of the possibility of 
generalizable research would be abandoned/ grounding would be 
required in every inquiry, human \befings would bec6me preferred 
instruments, and reports* would assume the' form of Case studies ox* 
other qualitative 'portrayals. (MN) •* m 
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FOREWORD 




. In a continuing effort to examine major issues that affect voc^ional-education research and 
development, the National Center for Research In Vocational Education^presents distinguished 
speakers in its National Seminar Series. To share the comments of these experjs with you, we 
prepare occasional papers from transcripts of their speeches. x ( 

In this paper, we are proud to shar^ the comments of Dr. Egon Guba on tfYe use of natural- 
istic inquiry methods to produce research that can result in a better understanding of how humans 
behaue. Dr. Guba, who has his Ph.D. in quantative inquiry from the University 6f Chicago, has 
been studying naturalistic inquiry for a number of years, Hfs comments challenge traditional * - 
methods of research and open new thoughts of scientific exploration. 

Dr. Guba has been an instructor of mathematics and physios and a visiting scholar at three 
universities a~d two regional laboratories, and a faculty member at four universities. He is currently 
a Professor of Education in the College of Education at'lndiana University, His publication topics 
include teacher effectiveness, educational administration, change processes, evaluation, and most r . 
recently,, naturalistic inquiry. He is a member of the American Education Research Association, 
American Psychological Association, Phi Delta Kappa', and the National Council for Measurement 

in Educatiort. ' ' \ 

> 

On behalf of the National Center for Research in Vocational Education and The Ohio State 
University, we present Dr! Egon Guba's comments on "The Paradigm Revolution In I nquiry: 
Implications for Vocational Education Research arid Development." 1 

Robert E. Taylor 
V Executive Director 

The National Center for Research" 
in Vocational Education 
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THE PARADIGM REVOLUTION IN INQUIRY: 
IMPLICATIONS FOR VOCATIONAL. RESEARCH AND DEVELOPMENT 

i • 

* / • * I ' 

** 

In his classic work, The Struciufe of Scientific Bevolutions, Thomas Kuhn (1970) has dfescribed 
how a discipline undergoes a shift from one paradigm or pattern for discovering "truth" to another. 
Such was the case of the shift from Newtonian to relativisticjquahtum) physics. Kuhn believes that t 
the institutionalized paradigm, the so-called "normal science/' is challenge^) by the appearance of 
problems or anomalies with which the old model cannot deal of which it cannot explain. When a 
, sufficient number of such problems or anomalies have arisen, tbf discipline is confronted by a crisis. 
Such developmehts stimulate the emergence of a new, competing paradigm, ^ struggle ensues 
between the adherents of old and new paradigms, and,*if the new paradigm proves equal to the x 
task, it gradually replaces the old. ^ * 

« Such a struggle is now occurring in the social sciences: between the established "rationalistic" - 
. paradigm and the emergent "naturalistic" paradigm. Whether or not the naturalistic paradigm will 

successfully deal with the problems and anomafies with which tjie rationalistic paradigm has not 
> been able to cope remains to be seen. There is no doubt that 'the confrontation will be lively, and 
*that the outcbme will have enormous implications for the conduct and meaning of research and , 
development in all fields, including vocational education. . . 

Today, my purpose is to introduce you to this new paradigm and to describe in global fashion 
whatH believe its implications are far research and development. I will begin by briefly describing . 
some of Jhe difficulties with the conventional paradigm that have sent R&D workers searching for ^ 
new and more satisfying approaches.* I will distinguish the new paradigm from the conventional in 
terms of certain Basic differences in underlyinc^ssumptions, and will alsp describe certain^postural" 
differences between them that have strongMnf luenced the day-to-day. conduct of inquirfTl will 
also deal briefly with the question of thejwttienticity of inquiry cbnducted within the new para- 
digm, since its critics have elected to cetfsurfe it chiefly on methodological grounds, charging that it 
is unbounded, unfocused, and not trustworthy (i.e., internally and externally invalid, unreliable, 
and nonobjective). I will close with a discussion of the* implications of the new*paradigm for voca- 
tional R&D and forfcducational R&D in general. . * ^ 

\ : . • 

. * % Challenges to the Rationalistic Paradigm 

/' * * " * 

Let me turn to a brief consideration of the reasons that the conventional-what I will call 
rationalistic 1 —paradigm has begun to be serfously questioned. • 

* » 

First, I wouid like to point out that while aggregatibllity of findings is one of the great claims # 
of pure science (that is, the disciplined nature of science makes it possible for each scholar to build * 
upon what has gone'before), rto such aggregatibllity is evident in the social sciences. Educational ^ 
research is typically dated from/the work of Joseph Mayer Rice published in 1894; thus, we have 
had mora than eighty yeacs^of Inquiry ancfinvestigation. But where are the gre?t principles that have 



emerged from all that work? While physicists might trace frie evolution of quantum mechanics back 
through Newton, Copernicus, and even to the pre-Christian writings of Ptolemy, where is the 
counterpart for educational research? Our work is not aggregatible, and I further suggest that for 
any given proposition about 'education, it is possible to find'about as many research works (at 
whatever level of iflgor you specify) hn one side of the issue as on the other. -Practitioners know you 
can prove almost anything yofi want t§ from the research literature. Even worse, findings taken to 
. be true ten or twenty years ago are surely not true today. 

Second, leVme suggest that no matter how useful rationalistic researcl^yprinciples are in the 
laboratory, they cannot be applied in the real world of social science. The basic conditions that 
must be satisfied to conform to rationalistic methodology cannot be matched in social or behavioral 
inquiry. If yve consider,. for example, the conditions that Campbell and Stanley (who are considered 
by some to have written the "bible" of research methodology) describe as being necessary for "true" 
designs, we see at once that we cannot establish needed controls, randomly select and assign subjects 
to treatment conditions, c>r blot out all of the possibly confounding factors that may impinge on , 
our inquiry. Of course, some researchers are inclined to dismiss this fact by arguing that noncon- 
formity to design principles arises only because of a false morality or because of political pressures. 
If we really understood that science was the only means to truth, we would not, for example, hesi- 
tate to expose pur children to possibly inimical conditions of research- Did not half the children in 
the nationwide test of the Salk polio vaccine recejv§ distilled water rather than the lifesavin^serum? 

* 

Whatthese researchers fail to recognize, ofcdurse, is that truculence or ignorance are not the 
only factors that produce nonconforming Qpnditions. It is thej/vay of the real world. Human, political, 
social, and cultural factors always influence inquiry. A paradigm that requires unrealistic manipulation 
i of these factors can have but little utility. \ . 

Third, I will argue that the traditional research paradigm has an ungrounded quality (G laser and 
Strauss 1967). To many researchers, inquiry is a game in which they pit their intellect against nature. 
The object of the game is to devise a theory or explanation to account for observable phenomena, 
logically derive hypdtheses or questions from that theory, and then tesrthose hypotheses or answer 
tho5e questions under carefully controlled conditions. The reward, if you guess correctly, is having 
your findings published in the reputable journals of your discipline. \ 

But it is lately a faatter of serendipity whether the theory one starts with has any isomorphism 
with the phenomena under study, ItVnb wonder that many people find research to be unreal and, 
meaningless^ this approach is largely'Yesponsible for the "bad reputation that "mere" theory-has 
earned. Inquiry grounded in observation, in a one-or>"one wrestling with the real world; is rare to 
science. Observation is selddm used to generatenheory, but only to.jest it. Thus, it is not surprising 
thaf the disjunctions between theory and fact are massive. 

Fourth, I suggest that the rationalistic paradigm fails because it depends essentially or> proposi- . 
tional knowledge and rules out tacit knowledge. The terms "propositional" and "tacit" (Polany 
1*958) differentiate between knowledge that caii be put into a language form from knowledge that 
on^intuitively knows or understands. People know more than they can say, but the rationalistic 
paradigm requires that whatever is to be studied must be cast ihtd the form of a hypothesis or 
question befor&the inquiry begins. Those making the inquiry are not permitted tojmmerse them- 
selves in a* situation, using themselves as tacit instruments to discover what may or may not be worth 
pursuing in t£at situation. As a result, all our instincts, our intuitive insights, the~!Vibes" we pick up, 
cannot become prdper objects for inquiry, they must be ruled out a^subjective in formatrorv Much 
4 of the valuable'knowledge in the.social or behavioral areas is eliminated from further study by this 
arbitrary dfctum.* • ' 



Fifth, it is extraordinary that the majbr value claim of science is that scientific inquiry is value 
free. The fact that this is not true, even in the physical sciences, is easily demonstrable. One's choice 
of. problem, of method, gf analytical tool, and of interpretative theory all are value mediated. 
Physicists know, for example, that whether light is "proved" to be wavelike or corpuscular in nature 
depends solely on which method one chooses; for example, Young's slit-diffusion experiment, first 
carried out in 1903, or Einstein's work on the photoelectric effect early in this century (Zukav 1979). . 
But if one were to stop at this level, one would miss the most important consequence of the value- 
free assertion: that the real value claims of our inquiring culture are assumed to be objective and 
rationally justified (valid). We do not stop to consider the possibility tftet there may exist alternative 
value claims that should be entertained. In essence, we are objective because we say we afe. Such a 
posture can survive in dealirtg with physical phenomena, but when it is also applied to social/behavioral 
phenomena, which are heavily value mediated, serious problems jfrat the conventional paradigm cannot 
handle emerge. 3 * „ . " ? 

. * • . . : 

^Sixth, I point to the overteliance on quantative methods in conventional inquiry. I suppose 
that sciehce has moved in this direction because of its seeming precision, rigor, and^bjectivity. I * 
recall that several years ago, when I was writing a monograph 6n naturalistic methods as a visiting /, 
scholar at UCLA, one of my temporary colleagues earnestly requested me to urge whenever and 
wherever I could that the naturalistic methods I yvas describing not be used by anyone who had not 
served a long apprenticeship in quantitative approaches. He felt Jhat only a person with such a back- 
ground could know the true meaning of rigor. But a quick conversion of qualitative phenomena to 
quantitative indices is a delusion if one is not careful about maintaining an isomorphism between 
the phenomena being v studied and the numbers being used to describe the v m. Quantitatively,oripnted 
convention?! inquirers are prone to bast the phenomena of their disciplines into numerical .form, 
manipulate the rtumbers, and solemnly assert that the results of those numerical'manipulations have 
their exact counterparts in nature. If mathematics show it to be so, who can doubt that it will be 
found to fte so in the real world? But withoura thorough grounding in real world phenomena, and , 
when the hypotheses to be tested or the questions to be answered spring largely from conceptual 
theories devised before contacts with reality occur, is it any wonder that this glibly expected isp- 
morphism is often not found to exist? 
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Seventh* the rationalistic paradigm is burdened by an overemphasis on rigor at the expense/of \ 
relevance.'The requirements of the scientific paradigm (control, comparability, and so c^if are~sp / 
assiduously pursued that virtually no attention is given to whether the findings wilfnave larrjHffiider * * 
meaning. Urie Bronfenbrenner (1976) has suggested that because of this heavy emphasis pn "ele- 
gantly designed" experiments, "contemporary developmental psychology is the science of the strange 
behavior of children in strange situations wi'th strange adults for the briefest possible periods of time*." 
In other words, the preoccupation of scientists with rigor has caused them to carry out studiesttiat * 
can be generalized only tb other laboratories^Wbile exhibiting great concern over the conditions for 
internal validity, they have ignored external vatfdity by default. It is no wonder that persons who are^ 
most interested in what happens in the best all possible worlds (e.g., the laboratory) rather than 
the worst of all possible worlds (e.g., the real world) find their restilts uninteresting. 

Finally, I suggest that the major indictmeft^one can make of research findings ^hat stem from 
the rationalistic paradigm is thet they, have no imp&ct^From a historical point of view, I find if * 
interesting that when Joseph Mayer pice published hisWork, The Futility of the Spelling Grind, in 
1894, he was chagrined that no one paid attention to it. That same tendency — to jgnore research 
findings— has become so evident today that it is one of the first observations that anyone who 
studies the American educational* research egterprite is fikely to make. The failure to use evaluation 

, .findings is virtually a national scandal. The U.S. Congress is impatient to know why the (nany Studies 
carried out and gnany entities developed with federal funds have not produced a "bigger bang for 

# the buck." V * ' > ' . \ 
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It would be simplistic to ascribe all these failings merely tq an inadequate paradigm. Larn sure 
that there are other contributing factors for each of the conditions; I have described. But I am 
equally sure that certain basic inadequacies in the inquiry paradigrfn itself can be faulted., It is my 
strong impression that'both practitioners and researchers in education have intuitively come to 
doubt the power of th©Nrationalistic approach to provide answers to tlpe questions that are now 
before us. They are looking for alternatives. Naturalistic inquiry is one sgch alternative. , 

The Nature of the Naturalistic Paradigm 

When I used the term "paradigm" I am describing a means for arriving at "truth: 4 * 4 There are 
manyjsuch paradigms with which, we are alJ familiar, such as the following: 

• The logical paradigm, followed in fields such as jmathematics, accounting, ' 
and philosophy, holds that truth is demonstrable in terms of a priori axioms 
j or assumptions (as in high school geometry). * . 

1 • The jqdgmental paradigm, followed in fi'elds such as win£ tasting, Olympic 

contest judging/peer review of proposals, or accreditation,vi$its to campuses, 
- . # holds that truth is reccflfnizatye by knowledgeable experts. 

The modus operandi paradigm, followed in fields.such as medical diagnosis, 

! forensic pathology, or television troubleshooting, holds that truth can be 

I obtained with some knowledge of the "characteristic causal chain?" of 

; - * phenomena. ' • 

I • The adversaria* paradigm, fallowed in fields such as criminal law; congressional 
hearings, or investigative journalism, holds that truth is "emergent" on balance. 
J ■ ' - * 

I The paradigms that hefe characterized what might be, canted disciplined inquiry, however, have 
been the incumbent rationalistic (or scientific) paradigm andthe contending naturalistic paradigm.. 
Th6 former, most often found in fields such as physics, chemistry, biology, and the other so-called 
"sciences," holds that truth is demonstrable or confirmable. J>e latter, typically found in fields ' 
fu<ib as ethnography, history, and political- seience, holds that truth is ineluctable; thai: is, it is 
inescapable when experienced over a sufficient length of time. ' ■ v , 

I \ • : t • * 

Which of the paradigms is '^ght"? There is, of course, no answer to Jthat question; if there 
wfere, the* field of epistemology would disappear, and there would be no further room for debate. 
Unfortunately, thare is no meta-paradigm or meja-criterion that might help us make an infallible % 
decision. Tfoere js no point to debating relative Tightness, for the qu^tion remains forever indeter- 
minate. How then c&n one mqke a choice? /• "\ £ 

These various paradigms, including the two of greatest Interest to us here, all rest on certain 
assumptions. When some ihquiry is to be conducted/and the question arises as to which paradigm . 
is preferable for conducting it, the answer should be determined on the basi$k)f which set of assump- 
tions is best met by the inquiry in question. Just as one Would not use a statistic without asking 
hether its assumptions were met by^the data to be analyzed, so one cannot choosy paradigm' 
ithmrt askind whether its assumptions are met by the phenomena to be investigated. 
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without asking whether its assumptions are met by the phenomena to be jjivestigatec 

Using such logic, we must now ask two questions. First, what are the basic«assumptions pf 
these two paradigms? Secpnd^hich set is more useful for the phenomena that social/behavioral 
researchers investigate? ^ 

4 . * . 

' "- . ■ • . • • : . . 4 . . ' - • 

, *^... ■ ' ., : .8 . ■ - ,. : 
• ■ -- -. . . • , . ' 



Lefcme begin by delineating the assumptions as"! understand them. I ask you again to hold In 
abeyance y^ur "natural"- tendency to choose one or another set as more self-evident. You may recall 
that when y<fo studied high school geometry, you were instructed that geometric proofs consist of 
demonstrating that derived theorems were logical consequences of a small set of axioms. When you 
asked what axioms were, and where they came from, you were told that they were self-evident 
truths. But of course that is not so, as subsequent developments in geometry have demonstrated, 
there are many different sets of axioms that can be adopted: non-Euclidean assumptions yield a 
variety of exotic geometries. And while these axiom systems often jdo not appear plausible, let alone 
self-evident, it turns out that all of them have validity for certain kinds of analyses. For example, if 
you are working with interstellar spaces, you are better off with Lobachevskian geometry than with 
Euclidean, even though the basic axioms of Lobachevsky are mind-boggling (e.g., given a point and 
. a straight line, it is possible to construct many lines through the point-*// of which are parallel" to 
the line). You must suspend your disbelief for the moment; we shall later return to the question of 
which set of axioms is more tenable for social/behavioral inquiry, however unbelievable they may be 
at first sight. 

* ASSUMPTION 1: The nature of reality 

Rationalistic axiom: There is a singular reality, which is fragmentable into bits and 
pieces (variables) ;.al I of which can be independently studied, and onto which inquiry 
can ultimately converge as*more and more studies are done. 

Naturalistic axiom: Reality is multiple (note the word multiple: the naturalist is not 
claiming many perspectives on some single reality, but multiple realities), which must 
be studied in holistic forms (or elsethey are destroyed), and from which inquiry wilj 
ultimately diverges more and more studies are done. 

ASSUMPTION 2: Sub/ect-ob/ect (respondent) interaction y ■ 

Rationalistic axiom: It is possible for the inquirer to maintain a discrete (also discreet) 
distance from the object or inquiry, so that neither influences the other. 

Naturalistic axiom: The inquirer and the respondent necessarily interact; each influences 
the other to some degree. 

* ASSUMPTION 3: The nature of truth statements 

Rationalistic axiom: The aim of inquiry is to devise nomothetic laws or generalizations 
* * (enduring truth statements that are context-free); generalizations are discovered by 
v " focusing on the similarities among different things. 

Naturalistic axiom: The aim of inquiry is to devise, idiogrgphic working hypotheses that 
"fit" a particular situational context; generalizations afe not possible, although there . 
may be transferability between two similar contexts: Differences among things are as 
interesting as similarities.. <Sk 

Which of ^hese sets of assumptions is better met by the social /behavioral phenomena which 
constitute our unique domain of inquiry? h suggest that the naturalistic paradigm is a hands-down 
winner. Consider the following. 

1 . Vn teality. For the physicist or chemist, the singular view of reality embraced by the 
rationalistic paradigmseems indeed apprppriate. It would be absurd to deny the self-evident reality 
of physical objects. The basic terms of physics-force, mass, time, velocity, and the like-demonstrate 
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t^e utility of dividing the world intp variables and studying their relationships. Successive experi- 
ments can converge onto some physical constant or basic principle. But for the social/behavioral 
inquirer, there is no physical reality. The "realities" being dealt With here are constructed realities; < 
that is, realities that are devised in the minds of persons to extend meaning to events and to render 
them interpretable and understandable. Everyone has an individual construction to account for 
his or her world. These constructions identify friends and enemies, what job demands are, whether , 
the person is healthy or ill, and so on. Political interpreters (reporters) make a living by constructing,- * 
realities about the events that take place at high political levels. Madison Avenue writers create , 
realitjes for us with respect to cosmetics, autos, or soft drinks. We social scientists construct realities 
that we call theories. But these constructions are not isomorphic to any real situations, as might be 
claimed for physical science constructs and theories. They exist only in people's min^Each con- 
struction is a complete whole; what -would be the value of sundering a mental image? TneFe also is 
no end to these constructions; inquiry cannot converge on them for there is, ultimately, nothing to 
lock on to. Indeed, the situation is quJte^the opposite, for as these multiple constructions are - 
investigated it is apparent that they lead only to more constructions. • 

2. On interaction (dualism). That there is no interaction between investigator and investigated 
object is a reasonable assumption in virtually all -areas of physical science. Chemicals react in test, 
tubes as they do in nature; they are insulated from the presence of the investigator. (But note that 
in the area of particle physics, the Heisenberg Uncertainty Principle challenges the assertion of 
independence even with respect to physical objects.} But it certainly cannot be claimed that there 
is no interaction between investigator and object when that object (the naturalist would prefer the 
term respondent) is another human being. Social/behavioral science has longtoeen aware of the 
possibility of reactivity, a pacrfcular respense to the investigator. But it also is the case that the 
investigator can react to theftespondent, and that both interact with each other. Within the rational- 
istic paradigm, such Interaction is assiduously avoided^ indeed, it is part of the mystique of scientific 
methodology that it is supposed ^guarantee that the results of an inquirywill be untainted by such 
subjectivity. But denial of an effecfcwill not change its impact; interactionnsthere (as anyone who 
has ever conduced research on humans can attest), and it does make a difference. The naturalist,^ 
far from being overwhelmed by 4 this circumstance, welcomes it because interaction makes it possible 
for the investigator to learn during the qonduct of study, to adapt his ev her understanding and 
methods, and ultimately to redesign the study as it progrfesses. For the naturalist, the gain in under- 
standing and flexibility is a more than adequate trade-off for the objectivity which is (putatively) 
lost. Such objectivity is never possessed by the rationalist. 

* 3. On generalization. The concept of generalization i\an inherently appealing ope. Who 
would not, given-a preference, opt for universal laws and principles that would hold at all times and 
in all place§? And surely, for the physical scientist, such an amtwign is not beyof\d achievement. 
That force should equal mass-times acceleration (F=MA) does not surprise us, whether in the 
eighteenth or twentieth centuries, whether on Earth or on Mars, and whether the accelerated object 
is a b^ll, an automobile, pr a psychologist'. Indeed, if anyone doubted this fact, the investigation 
that'led to the conclusipn could easily be repeated. But what of human behavior? The essence of a 
generalization is that it is time and context free, and who can name even one instance of human ^ 
behavior that is not heavily mediated by the situation in which it occurs? Two professors disdussing 
a point will interact very differently if they are part of a symposium at the annual meeting of a 
professional association than if they are at a local faculty meeting. They will again interact very 
differently if they have run into one another in the restroom. The naturafist wpuld not deny thadt 
there can be'transferability from situation to situation, but the degree of transferability can bel^r 
judged only if one knows a great deal about both transferring and receiving contexts so that the 
extent of "fittingness" can be determined. If the essence of generali?ability is to remove all contextual 
traces, the essence of transferability is to add as many contextual details as possible. The former is a 
% nomothetic move, typical of rationalism; the latter an idiographic move typical of naturalism. 



From this analysis I conclude (and hope to have persuaded^you) that the naturalistic paradigm 
is the paradigm of choice whenever one deals with social/behavioral phenomena. That conclusion 
is not intended to demean the utility of the rationalistic (or any other) paradigm for other purposes. 
Giyen the history of the hard and life sciences, for example, one would be a fool not to recognize 
tbe power of the rationalistic paradigm for those areas. But in the world of the mind} the personality, 
the social group, the culture, one is equally foolish not to recognize the power of the naturalistic 
paradigm. 

* Some Postural Differences 

' Whikthe rationalistic and naturalistic paradigms are differentiated most cleanly by the 
differences in their fundamental axioms, it is also the cajse that they are differentiated by certain 
methodological postures. Practitioners working from these two paradigms areriot compelled to 
take thes^f postures, but*seem to have embraced them fof historical reasons. (We do what we do 
ftecausetfbat is the way our mentors did it, just as we may believe what we believe because that is 
what our parents believed.)"" / , 

Several of these postures have already been alluded to in the opening paragraphs of these 
remarks; these postures, ft was charged, are responsible for some of the crises that x confront the 
inquiry community today. Rationalists have insisted on emphasizing rigor over relevance, a priori 
over grounded theory, quantitative over qualitative methods, and propositional over tacit knowledge. 
But it should quickly be not&d that naturalists have begun to show signs of an equally unsettling 
orthodoxy: relevance over rigor, grounded over a priori theory, qualitative qygf quantitative 
methods, and tacit knowledge as co-equal with propositional. But we cannot allow the situation to 
degenerate to a mere contest of wills, of winner take all, of right once-and-for-a1l. If the paradigms 
should be examined for degree of fit between assumptions and phenomena, so shouldrfhe postures 
be examined for balance. There is no intrinsic reason why an investigator, using either paradigm, 
cannot or should not be concerned with bothVigor and relevance, cannot usqfboth quantitative 
and qualitative methods, cannot invoke a priori theory so long as there exists grounding at some 
point in its development, and cannot admit both tacit and propositional knowledge so long as spme 
safeguards (see below) can be established to preclude mere intuition and guesswork. 

There are other postures that might be 'mentioned as well, including- 
, • reductionist .versus^xpansionht stance (convergent versus divergent inquiry; focusing 
the inquiry on a small number of predetermined variables versus focusing on holistic 
emergent patterns); 

V verification, versus discovery purpose (verifying existing hypotheses ratheifthan 
discovering new onfes); *•* 

• "objective" versus "subjective" instrumentation (using paper-and-pencil devices or 
physical devices, e.g., the polygraph, as*instruments versus using the self, or another 
human being, as an instrument); » * . 

• preordinate versus emergent (or cascading or*rolling) design (specifying each step in 
the inquiry ahead of time Versus making each step.contingent on all preceding steps); 

/ • intervention versus selection style (manipulating the situation to produce the 

circumstances to bFtested versus sorting through natursjly-occurring situations to 
find examples in which Nature has already arranged the experiment); 

" ' laboratory versus natural setting (carrying out studies in vitro versus carrying them 

out in situ); ) 



stable versus variable "treatment" (insisting on holding all treatments invariant during 
the course of the study versus allowing them to change as the situation may require); 

discrete versus holistic analytic units (doing analysis in terms of discrete data chunks 
-variables-versus holistic pattern analysis); and 

closed versus open inquiry (emphasis on control versus willingness to "invite inter- 
ferences-inquiry in the best of all possible worlds versus inquiry in the worst of all 
possible worlds). 



.For each of these postures, an appropriate bafcnce seemato beihp ideal toward which inquirers 
should strive. Of course, the rationalistic posture-has been overemphasized for so long that a more 
aggressive move in the direction of naturalist preferences may be appropriate for the time wing. 
But a hew orthodoxy must be avoided at all costs. a 

. ' . ■ s 



Is Naturalistic Inquiry Necessarily Sloppy Research? 



Wriile more and more persons seem to be willing to concecfe the occasional utility of naturalistic 
inquiry, that willingness is frequently hedged by an underlying conviction that such inquiry is 
inherently flawed: it simply cannot be authentic to the same degree and in the same way as is 
rationalistic inquiry. Naturalistic inquiry is, in the parlance of-the rationalist, "soft," "mCishy," 
"spongy," Is that charge justified? • * 

There seem to be three major discussion arenas of putative "softness." 

1. Bounding an inquiry. It is claimed that inquiry which is exparisionist/emergent, focuseU y 
on discovery, permissive of variable treatments, open to irfvited interference, and so on, is necessarily 
unbounded. How can the naturalist decide what* is or is not relevant to an inquiry under those 
circumstances? The naturalist may ctaim to be open-minded, but may just b^ empty-headed. 

• 2. Focusing an inquiry. If all options are open at the beginning of a'gaturalistic inquiry, how 
ton the inquirer sort the information collected into useful patterns? How,* in the parlance of the 
Jade, can the data be unitized and categorized? * 



3. Establishing the trustworthiness of an inquiry. How can the naturalistic inquirer demon- 
strate that the information gathered meets the traditional criteria of trustworthiness-internal and 
external validity, reliability, and objectivity? Does not the choice of paradigm effectively preclude 
bejng able to meet these criteria satisfactorily? ^ \ v * . • 

Let us consider each of these charges in turn. 

Bounding an inquiry. The task of bounding an inquiry is not essentially different for the 
naturalistic inquirer than It is for the rationalist. Both begin with an inquiry problem, and the nature 
of that problem is the key element in setting boundaries.,) Ijave discussed the nature of problems' ^ 
ancfthe ways that problem statements can be used to generate inquiry boundaries in other contexts 
(see Guba ^978, and Guba and Lincoln 1981). If there is a difference in the bounding situation for 
the rationalist and the naturalist, it is simply that the rationalist insists on establishing boundaries 
before the inquiry is undertaken, while the "naturalist is content to allow those boundaries tp emerge 
during the inquiry. It is pbssible for rationalists to establish a priori boundaries, because they tend 
to work from a priori theory with specific questions or hypotheses posited entirely at the preposi- 
tional level, anc^witlrpreordinate designs that will be held constant throughout the inquiry. The 
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rationalists then turn this capability into^a virtue, indeed, a criterion, by claiming that because they 
do everything in advance, they are free front the influence jof investigator bias or the tendency to 
capitalize upon accidental trends in the data. Thus they are alTfhe more objective, Naturalists are, 
however, no less rule guided or systematic; if they change rules in mid-study, they return to earlier s 
data and reanalyze them by the newly emergent rules, so that all data have received the same 
analytic and interpretative treatment in the end. Moreover, by keeping their boundaries open, 
naturalists gain the flexibility to adjust to new insights, to learn contiguously (they, do ribfh$ve to 
have it all down ahead of time), and to redefine the problem is nepessary. But an important 
point must be made. At every stage of the game, naturalist^, like ratfiorja lists, are guided by some 
form of problem statement; decisfons about what to include or exclude are as eas^ (or difficult) for 
them as it is easy Xor difficult) for the rationalists to explicate hypotheses or raise questions. 

m Focusing an inquiry. Rationalists, by virtue of having a priori hypotheses on questions, are Q 
able to specify exactly what kinds of data they. will collect, using what instruments, employing what 
analytic tools, and reporting in what form. (They-are often able to make up "dummy tables'' ahead 
of time, so certain are they of wh,at the inquiry will prod^pe.) Naturalists, on the other hand, begin 
data collection on a much more intuitive basis, and end with accumulations of observational notes,* 
interview prorocols, collected documents, and so on. All of these. materials are in very primitive (the 
rationalist would say "raw") form. How can naturalists process all these data, drawn from such dis- 
parate and possibly nonaggregatible sources, into something resembling reasonable categories? How 
can they decide'wliat particular, data items go where in this set of categories? 

"There can be r no doubt thaVthe unitizing and categorizing task is more difficult when one 
(confront^ masses of raw data already collected than when deciding that there are only three variables 
that will bewneasured, that they will be fc measured with a test, a questionnaire, and*a physical measure- 
ment, artd^that tfi^y will theq^be processed using the appropriate proflfcrn from SPSS. But in principle, 
the tasks confronting the rationalist and the naturalist are identical; thef'must ultimately decide 
, whatcan be drawn out f ronrr the variety of possible data that Will best speak to the problem being 
investigated. Again, I find the crucial difference to be timing. A metaphor that has been useful to 
me in considering this problem is that of preparing a test for any of the^several courses I teach. I can 
do all my work ahead of t*me by developing a hignly valid multiple-choice test with items that are 
all pretested, and for which I know the difficulty and discrimination Jevels. The development process 
-will require many hours and may span weeks of time. But once the test is developed and administered, 
it [s literally a matter of minutes to have, it scored by computer, have a grade sheet printed out, and 
post the results. Qh the*#!her hand,* I may choose to do all my work after giving the test. I cap devise 
a good set of essay questions in aboutlone-half hour, and jny secretary carveasily type and duplicate 
the single page of items. But, when I receive back ten pacjes of hand-scrawled responses from each of 
my twenty-five students, I 3551 confronted with a formidable task indeed. Many hours, possibly weeks 
of time, nrjay be required to read and judge all these responses. Similarly/ln focusing an inquiry, I can 
specify all of the*eJements ahead of time (a process that,may require weeks of thought), so that when 
I receive the data, I simply code and punch fhem and, in a matter of minutes, have my computerized 
analyses ready. Or, J^can collect data in a more open-ended way, and then spend my weeks putting^ 
themjnto logical categories.' ' / 

* , * * % - 

Yet the authenticity of my data does not depend in any way on which of these choices I make. 
4 do reap one important advantage by operating in the naturalistic mode, however. Since I can begin 
data analyses with rity first data source.(my first interview, my first observation, my first document), 
A can maintain an opeft or^mergent design, wit^subsequent data collection and analysts profiting 
from everything I have learned to that point (as againif being informed only by what I was able to 
guess ahead of time). - - f I 
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Establishing the trustworthiness of an inquiry. Trustworthiness strikes me as an especially 
important issue precijely because it is the area in which naturalistic inquiry is most frequently and 
rrpst vigorously attacked. In another context «3uba 1981) I have dealt with this problem with 
some thoroughness, but I will essay a brief treatment of this complex topic here. 

Criteria for trustworthiness and procedun^for meeting these criteria have been well evolved 
within the rationalistic paradigm. Four questio m may be used to identify factors that provide ^ 
"trustworthiness" assurances. ^ 

1. How can one establish confidence in the "truth" of the findings of a particular inquiry- 
given the type of subjects involved-and the context within which the inquiry was carried out? This 
is, in rationalistic terms, the question of internal validity; the rationalist's solution is to contrail 
possibl£ confounding variables or relegate them to the status of randomized variables. Random 
selection and assignment of subjects to treatments, plus overt control of whatever confounding 
variables §eem most important (e.g., intelligence in a learning study), provide an unassailable 
defense against tbe charge that a study is not internally valid. C 

2. How can one determine the degreefto which the findings of a particular inquiry may have 
applicability in other contexts or with other subjects (respondents)? This is the question of external 
validity; the rationalist's solution is to choose a sample group that is representative of the population 
for which generalization is desired. Here, probability sampling is the unassailable defense. 

3. How can one determine that the same results would be fouhd consistently if the inquiry 
were repeated with the same (or similar) subjects in the same (or similar) context? This is the 
question of reliability; the rationalist's solution is to demand reli.a«Hty indices that indicate the 
extent to which replicability can be attained by the instruments, the judges, the coding, and so on. 
Reliability coefficients that are in excess of commonly agreed upon levels represent an unassailable 
defense. 

4. "How can one establish the degree to which the findings of an inquiry are solely a function 
of the subjects and the conditions of the inquiry-and not of the biases, motivations, interests, 
perspectives, and so forth, of the inquirer? This is the question of objectivity; the rationalist's 
solution Is tq devise foolproof methodology that effectively insulates the investigator from the 
objects of inquiry and thereby guarantees that his or her own predispositions cannot influence the 
outcome. Demonstration of'faithful adherence to this methodology (scientific method) provides 
an unassailable defense. ' 

Naturalists have their own ways of dealing witMhese four generic questions. The same questions 
are as appropriate for the naturalist.as for the rationalist, but because of the epistemological differ- 
ences in their approaches, both the interpretation of these questions and the responses made to 
them differ. We may again consider each ib turn. 

1 Credibility. Rationalists, making the assumption of a single and realizable reality, consider , 
the test of internal validity to be the degree of isomorphism between their data and that reality- . 
is there a one-to-one correspoftdence?^ The naturalist assumes multiple realities that are constructed,' 
i e that have no real counterpart. Yet the idea of isomorphism can still be utilized. The multiple 
realities the constructions^xist in the minds of people; hence, the test of isomorphism is to deter- 
mine from the people, whether they find the data and the interpretations made from them credible. 
Credibility determined by actually checking with the persons who were the data sources (a process 
often called "member checking"), is thus the cornerstone of the naturalist's approach to internal 



validity.To build tfie probability that a study will be judged credibly, naturalists engage in certain 
activities or pose certain safeguards. They use prolonged engagement at a site to be certain they have 
identified what is truly salient in a situation. They persistently observe factors that ejnerge as 
crucial. They debrief themselves^with peers who are charged to ask difficult questions and to help 
-them maintain their sense of identity lest they "go native." They triangulate their data from multiple 
sources, using multiple methods and perspectives, and, if possible, multiple investigators. They 
collect and store materials (called referential adequacy materials) that can later be used as points 
of reference if some interpretation is in doubt— videQtapes ofr classrooms, documents, classroom 
products, and so on. Finally, they engage in the member-qhecking process on a day-to-day basis (for 
example, checking yesterday's interview data with today's respondents) so that they have immedi- - 
ately useful credibility feedback. • . \ 

A ' ' * 

2. Transferability. For the rationalist, the aim of establishing external validity is to guarantee 
thegeneralizabilTty o? whatever the study generates. The naturalist is unconvinced of the possibility 
of generalization, however, eX||pt in the limited sense of transferability of findings from one context 
to another if there is substantial similarity, between the two. Transferability is thus the key term for 
the naturalist. Two matters are of importance here. First, the naturalist is hardly ever concerned with 
sampling as the basis for transferability; whatever sarnples he or she draws uppn are likely to be 
theoretical (Glaser and Strauss 1967) or purposive (Guba and Lincoln 1981) in order to provide the 
widest possible band of information instead of typical information. Second, the naturalist will 
collect "thick" descriptiv%Jnformatipn about the context so that, if the question of transferability 
to a second context comes \p, ehough will be known about the studied context to make possible a 
judgment about the degree of similarity between the two. 

3. Dependability. Within the rationalistic paradigm, reliability is important because it is a. 
prerequisite for validity; methods must produfce stable results if those results are to be meaningful 
(recall the old measurement theorem that the validity of a- test cannot exceed the square root of <its 
reliability). 'Although naturalists are also*qoncerned with stability for the same teasons, the concept 
is trickier in this cealm. Since the rationalists assume a single reality upon wntch inquiry converges, 
they can treat all instrumental shifts as error. Naturalists, in assuming multiple realities and in using 
humans as instruments, must entertain the possibility that some portion of an apparent instability 
can be accounted for 6y shifts between realities or in the thrust of the instrumentation. Factors in 
such a situation change not only because of errors (mistakes or fatigue, for example), but also 
because of evolving insights. Thus, for the naturalist, what is important is not.that there is invariance, 
but that whatever variance does occur must be trackable, that is; accountable. It must be assigrtable 
to sources: so much for error, so much for reality shifts, so much for increased instrumental 
proficiency, and so on. For the naturalist, then, the key term is dependability, a concept that 
embraces elements of the stability implied by the rationalistic term reliability and of the track- 
ability requiretfby explainable changes. To provide some hedges, the naturalist may use overlapping 
methods (a form of triangulation; see for example, Webb et al. 1966) or split-teams (see "stepwise 
replication" in Guba 1978, and Guba and Lincoln 1981), but the most powerful tool is the depend- 
ability audit (Guba and Lincoln 1981; Guba 1981): a process that parallels the wofk of the fiscal 
auditor insofar as such auditors certify that the accounting procedures used are within normally 
accepted practice for the accountthg profession (i.e., that there has been no "creative accounting"). 
In permitting such an audit, the naturalist will maintain an "audit trail," or complete documentation 
for every process step. An essential part of this audit trail is the daily journal, in which methodo- y 
logical entries are systematically made. 7 

4. Confirmabi/ity. Objectivity has been a major preoccupation. of rationalistic followers, 
possibly because.the chief value clairti of the rationalistic paradigm is that it is value free. But 
objectivity is a "Holy Grail"; it is absurd to suppose that one's actions, which are determined by 



a series of human decisions, can somehow be rendered free of human predispositions. Methodology 
inevitably reflects the constructed realities of the investigators; the fact that they have decided to 
share a common, constructed reality makes n<x difference. One will inevitably find what one sets 
out to find, as in my earlier allusion to the wave or corpuscular nature of light. In the social sciences, 
the cultural and ethnic biases that can be built into so-called "objective" instruments such as IQ 
.tests are well known. Naturalists are especially aware of this problem because they understand the 
multiple realities (including multiple value systems) that can be encountered, and the roles that 
inquirers'eown dispositiohs can play when they use themselves as instruments. Following the reason- 
ing of Michael Scriven (1972), the naturalist shifts the burden of objectivity from the investigator 
to the data, requiring evidence not of the certH lability of the investigator, but of the confirmability 
pf the data. To build evidence for confirmability, the naturalist engages in data triangulation and 
practices reflexivity (Reipharz 1979, Spradley 1979, Ruby 1980), leaving an audit trail that enables 
a confirmability audit (Guba and Lincoln 1981; Guba 1981) to be done. Such an audit parallels the 
work of the fiscal auditor seeking verification for every entry in the fiscaj journal (the receipts, 
vouchers, and so on that attest to the legitimacy of entries), and for the totals that are calculated 
therefrom (the bottom line or the final interpretations and conclusions); 

From this analysis I conclude that it is possible for the naturalist to pose counterpart concepts 
Wto every "trustworthiness" criterion that has traditionally been used by rationalists, and to devise 
procedures that increase the probability that the criteria will be met. But you may recall that in my 
* earlier summary of rationalistic methods, I asserted that evidence of random selection and assign- 
ment of subjects, plus control of the chie^ confounding factors involved in the inquiry, provided an 
unassailable defense against a charge of poor internal validity, I also asserted that evidence of repre- 
sentative sampling from a population provided an unassailable defense against a charge of poor 
4 external validity, and so on. You may also note that I did not claim that the measures taken by 
' naturalists constituted similarly unagsailable defenses. Instead, the best naturalists can hope for is 
to increase the probability that they will have devised a minimally persuasive defense. In that sense, 
the naturalistic theory of trustworthiness is an inpomplete one-one cannot muster evidence that will 
compel another to accepf the trustworthiness 6Hhe study, but only evidence thaft will persuade the 
other of its relative trustworthiness. But this situation neither surprises nor dismays naturalists-such 
indetermin^jy is what they expect of the "real" world. The naturalists' response to someone who^ 
cannot tolerate that degree of ambiguity is simply to say,-"Whoever promised you a rose garden?" 



Implications \ 

I haye already asserted that the decision about which paradigm to use in guiding an inquiry 
must b^riade in terms of the degree of fit between the phenomenon to be studied and the assump- 
tions of each paradigm. 1 am sure that there are some areas of inquiry in vocational education for 
which the rationalistic paradigm is. best suited, and in those cases it should certainly b^dsed. But I 
am equally sure that the large bulk of the R&D done in this field (and indeed, in all educatipnal 
fields) would, be better served by the naturalistic paradigm. If that paradigm were to be adopted and 
widely applied, the implications for doing, reporting, and applying R&D would be fcnormous. I will 
try to deal with a few of them. 

1 . The entire conception of R&D 'would be forever altered. Virtually all the vocabulary , ( 
associated with R&D would disappear or be fundamentally changed. My wife, Yvonna Lincoln, 
•and I have joked from time to time about what we call the "methodfsm" of educational JR&D, 
intending the term to be parallel to the term "sexism/' Just as all of our cultural, often implicit 
stereotypes about fem^ps are caught up in the structure of our language, so are our stereotypes 
about research. Consider what it would mean to have to do without the.term variable. Who would 



want to use it after giving up the assumption of a single, fragmentabje ceality? What would it mean 

* to conduct research without terms sucfe as control, comparison group, representativeness, aggregate 

bility, and so on? Other words thaj now have otie meaning would meapr something e\se-sample 

would denote error plus trackable "true" variation, and so on. In shffri, to adopt this paradigm 

. implies a complete restructuring of the way we think about R&D. 

♦ 

- 2. The idea th&t there could be generafizable research that could lead to generalizable develop- 
ments would be abandoned. If generalization is not possible, because all social/behavioral phenomena 
are so intensely context mediated, it is patently not possible to dtpise research-baSed developmental 
^ products that have universal applicability. Instead, developments capable of broadband retuning and 
local adaptation would be required so that they could be fitted to whatever factors dominated in 
the local context. - 

3. Developments could not receive a "final" evaluation or be given a guarantee that warrants 
them for general use. While a product'^merzi(its intrinsic value as determined, for example, by its 
modernity, its internal consistency, its integration, ^pd So on), might be established that way (its 

r merit accompanies the product into any context), its worth (its extrinsic value as determined by 
jts usefulness) can be established only, with respect to actual contexts. In. other words, worth must 
be separately and independently determined in each and every context in which application is 

proposed (Lincoln and Guba 1980). Y 

* 

4. Grounding (Glaser and Strauss 1967) would be required in every inquiry. Current inquiry ^ 
is teually ungrounded in the sense that it is ba$ed not upon multiple constructed realities that 
characterize the respondents' view of the world, but upon the single constructed reality that is the 
inquirer's guiding theory. As Perrow (1981) has stated, so succinctly: - 

We social scientists try to eliminate disorder with rational designs. . ^ Write 
' articled with simple, orderly, elegant, anciinclusive theorems or hypotTfeses 
* or models: this is what the world should look like. Test the model with 
1 questionnaires that subtly create for the respondent the world we want to 
prove Exists, what Orne'-calls-"the demand characteristics of research instn^ v 
ments"— demanding the kind of behavior you wish to prove exists. Force a , 
tight coupling between the work and the deed. 

We force that tigfat c'otfpling,by our view of what science should be. We assume 
N that rational accounts of even so-called irrational behavior can be constructed 

v and then conf irrned by testing hypothese generated from the accounts. But 
every step of the way contains self-imposed deceptions. The questioos we pose 
to subjects assume the subjects share the world the social scientists have ff 
imagined, arid in the'course of this questioning we elicit responses favorable 
to that world conception, (p. 6) / 

5. Human beings would come into fashion as preferred inst(uments. The instrumentation that 
is common today could pot exist when the design is emergent, when the problem or the method- * 
ology caashift in mid^ream, when c(ata are focused, categorized, and analyzed by developing rules,, 
and when hypotheses or questions conje into focusjoply after the inquiry has progressed* To main- 
tain the needed degree of flexibility and adaptabili^ an instrument is necessary that can learn, in 
short, ahuman being. I have always found it odd that in scientific inquiry we tend to reverse the 
order of priority acporded to evidertce in legal courtrooms. There the best evidence is eyewitness , 
evidence; evidence that cannot be corroborated by a witness is termed "circumstantial," arid 
virtually no {$se can be won on circumstantial evidence alone. But we researchers denigrate human 

* testimony, calling it "merely subjective," while exalting circumstantial evidence such as test scores * 
and questionnaire responses. Use of the naturalistic paradigm will surely militate against that tradi- 
tionafjioMire. \ 




6. Reports would lose their present technical, quantitative orientation and take the form of 
case studies of other qualitative portrayals. Vyhen there is no generalization, the statistical table, that 
summarizes everything worth knowing cannot be produced. If the context requires "thick descrip- 
tion" to bfe understood, substantial portions of reports would have to be tfevoted to such descriptive 
passages. Th#airo of reporting would be to improve the understanding of audiences, rather than to 
impress professional colleagues with technical niceties. The "executive summary" that boils ey?ry : 
thing down to a few summary principles would have to be abandoned-the reader who is unwilling 
to invest enough time to become immersed in tne data would not be 3ble to understand the report, 
for there would be no shortcuts. • \ , ** • 

7. Policymakers would need to reorient themselves to the use of R&D data. At the moment, 
policymakers are demanding-and getting-R&D information in highly compressed form. Given |he 
democratic form of government under which we live, it is not unreasonable for the lawmaker, for 
example, to look for a single nurhber or a single phrase that best "represents" constituents' needs. 
And the rationalistic paradigm offers that lawmakers very assurance that he can have what he wants 
-that it is possible to summarize matters in a few numbers, to develop generalizable principles on 
which the lawmaker can act, and to prove them on the basis of one grand, national, numerical 
experiment. Information generated under the naturalikic paradigm does not have those qualities, 
however, and while it may be disappointing or frustrating to policymakers to deal with information^ 
on a much broader, nonaggregated, nonsummarized, qualitative differentiated way, better decisions 
will surely result in the long run. \ 

, 8. The R&D worker who shifts to the naturalistic plradigm will take grave risks. It must be 
remembered that it is the naturalists who are challenging ahd the rationalists who are entrenched. 
Politically, rationalists dan seem'to offer the public what itWits. Methodologically, naturalism is 
not nearly so well developed and is open to multiple challenges. Naturalists who apply for funding 
are likely to confront program officers who neither understand nor appreciate what they are trying 
to do. (Students have a parallel situation in seeking to persuade dissertation committees of the 
legitimacy of what they propose to do.) Reports are likely to go unused because readers do not 
find a "quick-and-dirty" executive summary, or a few nUmberi or phrases that they can easily 
incorporate into their thinking. Journal editors and publishers sire unlikely to be^ble to juHge the 
quality^of work done in this mode, and may reject papers or monographs for no other reason than 
that the thick description they contayi exceeds their publication^ space limitations. Tbtfs, one can 
predict that the way will not be easy forthe inqitirer who decides\to "&o naturalist." Fortunately, 
the uncomfortable position- that is created by usjng this paradigm has never deterred those persons 
who have felt a special sense of mission. I trust tfia^such dedication will ^continue. / 

9. Finally, a measure of value-resonance will Be restored between the substance of our , 
inquirers and the methods we me to engage in those inquiries. The claim that the rationalistic 
paradigm is value free has, by definition, obscured the problem of the\relation between substantive 
and methodological values in inquiry. I haye already quoted Perrow (1981) as assorting that our 
research has certain demand characteristics-that we find our world to be what we structure it to be. 
If this is the case, it seems imperative to me that when we do make inquiries, we use a paradigm 
whose assumptions (values) fit those of the field we are inquiring into. Pferrow makes the point in 
relation to the study of administration. He says: ? / \ 

. , "/* To put a concept on this ppint and take my next step in dismantling social 
1 sciences, let me observe our world is more "loosely coupled" thin our 
rationalistic theories would ever allow- What loose coupling mearis is that 
there is a great deal of redundancy, slafck, and waste, and it is whe\i we ignore 
this that we are .successful at accounting for reality, at explaining the world 



in a rational way. ... In time, we convert all" Jhe aspects of loose coupling- 
the slack, buffers, redundancy, and waste-into a benign overview of a well- 
functioning system. We convert micro-confusion into macro-order, (p. 6) 

To put it another way, if we are to deal with "loose coupling," we cannot study it with a method- 
ology that presupposes tight coupling; there is then no value-resonance, aad erroneous conclusions 
will surely result. 

Another example: a graduate student in reading at IndianaXIniversity with a minor in 
methodology is currently writing a paper for me that /elates methods of inquiry to theories of 
reading. Classic theories of reading, she asserts, treat reading skills as elements that are external to 
students. Yet these are skills that they must acquire. These skills can'be separately learned-work • 
recognition, elements of phonics, and so on. If one wishes to study reading under those theories, a 
rationalistic approach seerps quite appropriate: the reading process can be broken into separable 
bits called skills, each skill* can be independently manipulated, the interactions of each skill with 
student characteristics such as age, sex, IQ, and so on can be determined, and so on. But our reading 
department is interested in a rather different view of reading. In this view, the process of reading is 
treated as a holistic process that is internal to the individual. It is not separable into components. 
If students stpdy reading from that theoretical perspective with a rationalistic paradigm, how can 
they expect anything to result except unintelligible data? 

It is my contention that there has been a similar value misfit between most of the phenomena 
we are interested in studying and the methods that we use to study them. We did not make an 
unreasonable mistake. After all, the rational methods of science had scored prodigious successes in 
fields such as physics, chemistry, and biology^The scientific method provided an aura of legitimation 
for our fledging inquiries that would have been impossible to attain in any other way. 

* • \ 

We can perhaps be forgiven if we did not notice, at first, that there was severe value dissonance 
between the conventional methods of science and the problems confronting the social/behavioral 
inquirer. But we are now in a position to appreciate th^t fact, and we no Iqnger need the legitimation 
that the scientific method once bestowed on its adherens. It is time, in short, to break away; despite 
the risks, despite the upheavals, and despite the reorientations that will be required. For most of the 
purposes we seek to achieve, the naturalistic paradigm is the method to choose. 



15 



19 



QUESTIONS AND ANSWERS 



Question: Your.articulate'and stimulating point of view is useful in giving us an opportunity to 
reexamine the presuppositions on which the scientific method rests. But your 
. 'suggestion that we replace the hard-won scientific techniques in tfie speial/behavioral 
domain with an unprover\.set of "natyrali&tic" observatianal procedures reminiscent 
of the anecdotal reports and casjfr studies of decades past is unconvincing. Not only " 
are you throwing the^aby out with the bathwater, you seem to be locking up the 
» bathroom and leading us back to the outhouse. 

Toward the end of your paper you acknowledge that the "rationalistic" approach 
* may.be better for investigating some questions, though you prefer the "naturalistic" • 
approach for jnost purposes. Since the title of your paper mentioned ^Implications . 
for Vocational Research," what'are some examples of vocational research questions * 
that are best Suited. for each approach? 

You're concerned that I go too far, I know at times, the paper takes a very extreme position 
that says all numan behavioral questions ought to be attacked by naturalistic inquiry. Later on I * 
leave the door open for at least some questions that might be attacked by rationalistic inquiry. In ^ 
regard to your question on the title of the paper, I chose that particular title with trepidation. I 
would have preferred to leave off "Implications for Vocational Research and Development" because 
I do not know enough about the field to understand what the implications are. I don't know what 
the major research issues gr questions are. The assertion I want to make is that the choice of method 
is up to your assessment of what you believe are the best fit assumptions, I traveled here yesterday 
and spent the night with some friends in Columbus. They had a friend that they invited over for 
dinner who got very interested in this same particular problem and was pushing me very hard dn it* a 
I tried to give some examples, and it turned out that her background was in the biological sciences. 
Shesaid, "AHof my training leads me to believe that human behavior is ultimately gdheiically 
determined. Whether ybu believe that or not, that's the theory I propose to work from; and if I take 
that posture, wouldn't- it be true, by your own analysis, that I should apply the scientific analysis , 
because genes, after all, do have a tangible reality?" My response to that was to say, of course— if 5 - 
you really thought that you could account for behavior by some series of genetic expressions^hat 
could ultimately be (inked back to the biological genes in each of the <&Us, I would suggest that you 
have a substantive theory whose assumptions are very like the assumptions that are rationally secure. 
You, therefore, ought to use th6 rationalistic method. But, if you believe as I 4 do that at best only a 
Smajf portion of human behavior is genetically determined, and that much of the r^st of it is con- 
texttially determined or determined through theexperience of earlier contexts, iribluding the 4 
experiences at mother's knee, and so forth, then 1 do not believe that the assumptions of the ration-* 
alistic paradigm fit nearly as welt as the. assumptions of the naturalistic. I keep asserting that behavioral 
phenomena are different from physicaj phenomena. I know that stfme portion of vocational education 
is given over to the development of skilly. And, }r\ that sense, there would be an analogy to my. exam- 
ple from reading, tf you believe that the vocational behavior, Jf there is such a term, of people has 
only to do with the acquisition of certain- Wjjds of skills, and if you want to research how those 
might be most effectively taught, you vifould probably^be well advised to bse the rationalistic m 9 
paradigm. On the other Hand, there may be other aspects^of vocational behavior, such as career 
'choice, that are largely a matter of reality construction. For example, observation of certain kinds , 
of role models or exploration of one's attitudes and interests with respect tp career choice might , 
find the naturalistic paradigm touch more congenial. I do not think that there is any way of describ- 
ing in an internally true way the process by which career choipe decisionsare made. What I urge you 
to do is to^stqp and ask,yourselV"H<^am ^conceptualizing this? What method would fit?" Then 
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*ry to pick accordingly. I think one of the implications of what I arp saying is that two different 
people attatking the same problem may formulate the problem in sufficiently different terms that 
one would be led to use of the Nationalistic paradigm and Vhe other to thajiaturalistic para,digm.«l 
have no objection to that as long as they understand thp game thfey are playing. They have to be 
explicit about the assumptiqrjs.and .make an informed, intelligent choice rather than just slipping 
into it because that is the way we have always done it. . 

Question: If ('understand your distinction between single and multiple realities, the natural- 
, ' * istic approach denies the universal nature of certain societal processes such as the * 
* production and distribution of goods and services or the transmission of culture 
across generations. If yjbu deny such unive?sal processes, what happens to scientific 
• inquiry? If you do not have cumulative, genefafizable knowledge, all you h^ve is 
» careful journalism. . ■ ✓ 

You can define it that way. Science has those characteristics, and those things that you are 
.urging us to do fail in one or another or both % of thosejtests, and therefore, they canhot'be Science. 
It is not important what you call it. I do not much care for the label "Scientific" anyway, because 
in our culture science is accepted as truth: It is such an orthodoxy that the worst thing you can\ „ 
say about something is that there is no scientific evidence in support of \t There is no scientific 
evidence in support of anything one does. However, yqu^ieve inwhat you. do, and you act as 
though it were true. Most of the time feting on that premise work v s oat very well. You : can circurrv 
scribe science any way you want to,- ahd if you put^those conditions on it, jfhen I. would have to 
agree that naturalistic inquiry is surely not science. If you say that the aim of science is to produce 
generalizations, and if you have a group of people who say they are not interested in that paradigm, 
then.by definitfdn, they cannot be scientists. ^ . 

** 

Question: Concerning the extrapolation of data, or interpretation of data, hpw would the 
rationalistic researcher go about interpreting the data versus the naturalistic* 
researcher? The'naturalistic researcher seemfe to conduct research without prior 
assumptions on a problem that is previously defined. The rationalistic researcher - 
has reviewed the. literature and defineda specific problem, or has set up a 
hypothesis and tries to disprove it, The example is the man who gat on the horse . 
and rode off in all directions. Which way did he 

« • 

How does one know what is relevant and.what is irrelevant? I think the answer to that is that 
\ know in exactly the same way "that scientist do. Scientists just looj< slicker because they started 
out with some questions or hypotheses, and that makes them look more structured. They alsp 
appear more rigid, by the way. Ask yourself where those hypotheses or questions come frorp. they 
came from some earlier c9nsideration, which may> in fact, not have even been explicit The partic i 
ular questions or hypotheses to be investigated come oi^t of the interaction^etween that.problem 
ahd some kind of theoretical perspective that the scientist has chosen to bring to bear. This latter 
step is typically much more explicit because we require people to r^Dort it. We da not require 
people to report where they got the problem. W£ require them to report which particular theory 
they are going to use to handle the problem. They also are required to haVe some discussion about 
why they find that theory relevant to that problem. "Now that makes it all Ipok as if the "scientist's 
mind is a great deal more structured and that obviously the scientist will know what is relevant to 
a'much greater extent than someone psing the naturalistic method- But naturalistic inquiry can start 
With precisely thersame problems. Instead of form ulating a priori hypotheses or a priori theories, 
naturalists cause them to emerge by looking at the phenomena studied. And hoy^do I know what 



phenomena to study? I do not study just any old thing. For example, if we'broucjht twen^o^servers 
* into this rdom and told them to describe to(fay's events, without npre direction than that, of course 
they would come up with completely different and unrelated descriptibrjs. We jnight have another 
person come in who is an expert in large group instruction and who might observe what I am dpjng 
here and ask, "Did you evei; hear a worse lecture in all of your life?" Alf§orts of descriptipns might 
appear. But what if we sent twenty people \x\ here with some problem to focus on£letus imagine 
that the problem relates to large group instruction and its r'elative effectiveness. Then, I think they 
would make much closer observations. If someone dropped a bag full of qathrvjo ?n thp floor nonp 
of the observers would think that was relevant to ttje problem. But if somebody raised a quest?5f 
from the floor that impinged on-the problem, the obser^rs would recognizfe that as'relevanUSo for, 
me as a naturalist, those judgments are made continuously. as I go along. They are r^fined^over time 
as my grounded theory begins to sharpen up and as I begin to foriJs in orj sensibly questions to ask; * 
questions that f could not h^ve knpwn in advance. ^ t v ■ - ' 

' J ' • 

Question: What is the difference between the naturalistic approach and quasfc-experimental 

\ designs? Campbell and Stanley's criteria for choosing a design v^ere. based on inteenaf * 
validity. Yours is based on external validity. I do not see a difference. 

Campbell and Stanley do not move out of the scientific paradigm fora second. They are nuking 
a slight bow toward the realities of the world. Unfortunately, there are scalawd&s who prevent scien- 
tists from finding truth wherever they f ijnd it. They will not let us do such thin^s.as match groups or ^ 
make random selections or assignments. So we do the best w§ can, and tfierefore,\we h^e*to 4 fal1 bfack 
on quasi-designs. In*principle, there is no difference in the terms of the assumptions on which that 
approach rests. What they are saying is that we have to make some concessions to Jhje reaJftfes of life. ^ 
Then Campbell and Stanley s^to use multiple technicjpes because each of the techniques ftasVweak 

> point iait somewhere. It is not7ife>a true design. If you use the techniques in tan<#m and'pjgk thefm 
wisely, Ihe Weak point in one designVcovered by a very strong point of another design and evenjualjy 
(ycftrwrn get them to work together. In my t>pinion^qua^i-designs are approximations to true designs* 
and they urge us to use them because the real world militates against our use of the true designs. They 

, do not idffer in their intent at all. What you are trying to do, the nature of the inquiry, the kinds of 
problfemsyou would raise, the methods that you would use, only allow you to make certain com- 
promises. For example, instead of bein§ able to make a group comparable ahead of time, by random 
selection or assignment, you try to find groups that are similar by getting- some of "their characteristics 
and seeing if they are similar in terms of means and standard deviations (^whatever. The researcher 
does ex post facto matching rather than a priorj; It seems to me to be an approximation 6r patching ' 
up of $ome inherent difficulties when one applies cjuasi-designs irf the real world. Not for Umjnute " 
dSes it mean a different vjew of reality. Researchers are still trying to pj-qcluce generalizations. They 
still think ^here's only one reality out there and their inquiry will convdr<)&x)n it. 

- V _ ' • ' • 

It is certainly true that the differentiation fhjat Campbell and Stanley make between true X* 
designs arid quasi-designs are not of both externatand internal validity, but more of ifiternal validity. 
'There's a small* bow in the direction of external validity. You may remember that GeritfGla&s toojc 
them to task by indicating that they had greatly underestimated the Importance of their suggestions 
for the influence or impact that it would have on external validity. As"a patter of fact,*in a paper 
on trustworthiness, I took those eight threats that Campbell and Stanley talk^bout-and said, "Suppose 
I were to apply these to qualitative methods within a naturalistid framework, what would I come up 
with?" My conclusion on that analysis was that there was only one of the eight in which the natural- 
istic paradigm might be-likely to come out worse. It came out at least as Well pr better on the other 
seven. As for your assertion that you do not see any difference between the naturalistic appfoaqh 
and what Campbelf and Stanley call a quasi-experimental approach, I do not knoW what to say about 
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except to rehash again thaj; what they say is still predicated on a fundamental set of assumptions. 
They do not pretend that they are moving but^Qf an inquiry paradigm. They are just talking about 
ways thatch up true experimental designs. 

Question: • Can I comment on your reference to sloppineSsln research? It seems as if you are 
pointing out the necessity of having a professional with precise skills to carry out / 
. naturalistic rese^ch. Are you writing or planning to write something on criteria or 
guidelines on qualifications that Should be required of naturalistic researchers? 



Before I answer the question, I want to point out that it would be at least equally valid for h(ie 
to raise a similar question with respect to the rationalistic paradigm. But no one ever seems com- \ 
polled to do that.. No one ever Bays, "Doesn't it take a special person with a special kind of training 
to use the computer and apply appropriate measurement methods?" Everybody takes it for granted 
t that people will h^ve been so trained. It is certainly true that it is possible to do sloppy research 
within any paradigm, if the person who does it is an incompetent person; not appropriately trained. 
1 point -that out b«ftai|j^ people tend to believe that lack of training is a unique.problem to natural- 
istic approaches.'! do -not think it is unique tot all. But in a more direct answer to your question, 
surely there are some skills that one would want such people to have: personal characteristics and 
..modes of operating. In the book by Yvonna Lincoln and myself, Effective Evaluation-, there is g 
chapter in which we begin a look at the topic of usmg the evaluator as, or thetuman as, an instru- 
ment. The chapter actually Has three parts. One is a section that deals with the trade-offs that you 
gain by usin^a human as the instrument/a second one deal* with the desirable characteristics 
people oucjht to have if they want to be instruments, and a. third part deals with things you can do 
to improve the instrument, such as when you are working with a paper-and-pencil test. If f for 
example, you are not satisfied with its reliatfHity, there are things that one ca^n do to improve the 
reliability of the t^st. So there are things that one cap do to improve humans a* instruments. T^ey 
are, by far, more infinitely perfectable than * paper-and-pencil test.' - ^ 

„ * ■■ . , . > 

Question: If naturalistic inquiry is a new research paradigm, does the existence of new - * 
methodology suggest new kinds of problems? 

Lexpect so. I do not think tharthat is uniquely a function of the naturalistic paradigm. I think 
thaflny^tim^ you put yourself into;a different posture, you are going to see some problems that 
you had'npt seen before. We could have quite'an interesting discussion about that. However, I do 
not think that it is particularly.germang to the poirtt I was making with respect to establishing * 
bounds, which was simply to say, "Howlio you know what to include or exclude?" My answer to 
that was ruled by'the nature of the problem. You will certainly find many, places to apply it that ^ 
you might not otherwise have thought of before. In a sense, that constitutes some new problems 
that will surely occur. I think that it will be heaithy^nd I would be glad to $ee that happen. 

Question: Afe you concerned about use of results from a naturalistic study? If a study cannot 
\ , be generalized easily, whojs going to use it? As you commentedaarlier, the point is,' 

* w6 are trying to give taxpayers inforpiation on research: How can we best do that? - 

Those -ere certainly important questions. \ hear those questions al) the time, along with a lot ^ 
of others that might relate to the general topifc of the practicality of naturalistic inquiry. "We do ' 
not have time or the resources to provide information to taxpayers." "They wifl not understand the 
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results; they, wi[l not use the data; they will not underwrite the research in'any way when so little 
can be specified from it." A whole series of problems of that sort exists. Yet, I do not know what to 
do about them. I am chagrined because students cite them to me as a kind of indication for doing 
something else. They say, "Since it is so inconvenient to use the naturalistic paradigm, why don't 

*you let us do a survey questionnaire like all of our'other friends in the department do who don't 
happen to have you on their committee?" My response to that is I am sorry if the naturalistic 
method causes extra work or extra concern for the student, but\the practical contingencies that 
we can point to do not give gne license to do bad research, especially wherryou Knowit is bad 
research. To say, "I can't do the job well, I don't have the time or money so instead I'll cfb it [ 
poorly"' cannot be morally justified. So I am concerned about this issue, and wftile I am puzzled 

"as to what to do about it, we must not back away from establishing the naturalistic paradigm's 
trustworthiness to taxpayers and policymakers. 

/ < ■ ' V 

Question: How can Hocate your new paper that came out in summer 1981? 

It is Called the Trustworthiness of NaturalisticJnqulries, and it was published in the Education 
Communication and Technology Journal. 

Question: I am bothered by your implication that we must use either one method of inquiry 
^ or the other— thfet there is no point of compromise. My background is in history 
aridtiistoriins i^the naturalistic paradigm, so I am familiar with it; but in voca- 
r tional edCication, this area appears to benefit from the use of the quantitative 
1 pardSigrrvIs there some futuce time when we will b^ble to benefit from both the 
1 quantitative and qualitative methods? 

I do not see a time when the two methods can be merged, but then, it's the spirit of your 
question that leads me to differentiate between what I am now calling fundamental axioms versus - 
postures. Now I would regard the struggle of quantitative vdteus qualitative as one of the postures. 
There is a lot of literature now that would lead one to believe, if you did not know^etter, that the - 
whole discussion is about quantitative Versus qualitative methqds. I do not believe that for^i minpte. 
I think it is a discussion differentiating between paradigms, not qualitative and Quantitative research. 
So there is no reason in the world why you could no\ support naturalistic inquiries with both 
qualitative and quantitative methods. Similarly, you could support scientific inquiries with both, 
qualitative and quantitative methods. Jt happens that there is a high correlation in praqtice'in one 
direction, but there is nothing compelling about that, it does not have to be that way. Most of the 
postures, the preference of a priori versus grounded theory, for example, or the emphasis" on rigor 
: over relevance, are all matters on which I think compromise is not only possible, but desirable. I 
urge people to look for some kind of balance. But tjiose postures are very different from these 
so-called fundamental axioms. I just do not see how you could ppssibly compromise between one 
reality and multiple realities; you must make a Choice. I do not see how you can compromise in 
thinking that you have no interaction with a respondent c>r that yoi/do. I do not see how you can 
compromise with saying generalization is possible or it is not possible, or that whatever statements 
you make are always context mediated versus context free. I just do not see how there can be com- 
promises on those questions, any rgore than there can be a compromise between quantum physics 
and Newtonian physics. They are just different. 

' / 
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NOTES 



J. In my earlier writing preferred to this paradigm as the "scientistic," but I was persuaded to alter 
this apparently pejorative label to "scientific" by well-mifeaning friends who pointed out that nothing 
was gained by projecting hostility. After some time other friends suggested that I was doing the 
naturalistic paradigm a disservice by labeling its competitor with such a highly respected name; since, 
in our culture, science is so highly valued that, by implication, its adversary must be less valued. I 
then became aware that the term "rationalistic" was coming into more common u& to describe a . 

_ajmplex of related ideas, saekas the rationalization of administrative theory described in Perrow 
(1981). I have therefore adopted the same term here. Readers acquainted with^my work should 
r^tanize that I intend the term to cover everything implied by my earlier use of "scientistic" and 
"scientific." • - ' 

2. Ray C. Rist has reminded me that the German word for science is "wissenschaft," based on the 
root, wissen, to know. But German has two words for know: wissen, to have knowledge of, and 
kennen, to beacquainted with. One knows (wissen) scientific facts, but one knows (kennen) people. 

I am tempted to equate Polanyi's terms propositions! knowledge with wissen and tacit knowledge * 
With kennen. It is then but a short step to suggest that if the rationalistic paradigm is based on wissen- 
schaft, then the naturalistic paradigm might be said to be based on kennenschaft; a neol^ism, to be 
sure, but a useful one. 

3. I am indebted to Tom Schwandt, a graduate student in vocational education at Indiana University, 
for helping me understand the consequences of science's value-free* assumption, for two recent 
examples that deafwith this question, see Krathwohl (1980) and Guba and Lincoln (forthcoming). 

4., The discussiop to follow draws heavily upon Guba and Lincoln (1981). 

5. Of course the rationalist cannot demonstrate internal validity by testing for isomorphism directly. 
To make such a test, one would neecfto know what reality was like; but if that were possible, there ^ 
would° be' no need to study it. What the rationalist does in the face^of this dilemma is to disconfirm 
competing,hypotheses-the major hypothesis (the onethr£ inquirer believes in) can never be directly 
confirmed. . - . ' ' 

6. I am^ware of the factthat findings or interpretations may b& declared incredible for illegitimate 
\ reasons; people sometimes do engage in self-deception or evert lie when it is easier to declare an . 

\ assertion false than it is to face up to its implioatipns. Techniques *xist for handling this problem, 
\ however. See for example Douglas (1§76) and Guba and Lincoln (1981 ). 
t : - • 

J 7. It is not entirelydear what such a journal should cont^iri. I believe that at a minimum it should 
have four parts* 0) an initial statement of expectations By the investigator about what he or'she 
thfjnks wiltbe found; this statement can be ehecked against other versions written at later stages of 
the inquiry (say^ atthree-mqnth intervals) to help decide whether the investigator continues to see 
the situation in terms of the original expectations or whether the original conceptions are altered 
overtime, (2) a diary containing the investigator^ day-to-day entries about anything considered 
important or meaningful, including the individual's own emotional reactions, (3) a set of method- 
ological notps, in which the investigator documents each decision made that moves the investigatiort 
into next Steps or that alters its direction in some way, and (4) a set of continuing data analyses 
based on all information collected to date that will be used to plan next steps and/or form the basis 
for|hefinaranalysi^andinterpfetation v 
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